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Background 

This  research  was  conducted  as  the  initial  phase  of  a  research 
project  in  support  of  a  Marine  Corps  requirement  for  improved  unit 
and  individual  performance  measures  to  be  used  in  conjunction  with 
the  Tactical  Warfare  Analysis  and  Evaluation  System  (TWAES) ..  TWAES 
is  a  computer  based  system  designed  to  improve  the  control  nnd  eval¬ 
uation  aspects  of  Marine  Corps  field  exercises.  A  survey  of  existing 
performance  assessment  systems  and  methodologies  was  deemed  necessary 
prior  to  initiating  research  approaches  in  this  area  to  insure  that 
a  wide  range  of  viable  alternatives  would  be  considered. 

Approach 

A  simultaneous  effort  was  initiated  to  review  the  literature  in  the 
field  and  to  determine  the  state-of-the-art  of  existing  performance 
evaluai  ’.on  systems.  Observation  of  Marine  Corps  field  exercises  and 
examination  of  related  U.  S.  Army  systems  were  conducted  along  with 
an  in-depth  review  of  such  literature  areas  as  unit  and  individual 
performance.,  performance  evaluation,  decision  making,  and  training. 

Discussion 


Participation  in  a  Marine  Corps  Brigade  level  field  exercise  and 
observation  of  subsequent  unit  debriefings  involving  the  use  of  TWAES 
revealed  a  number  of  areas  requiring  research  support  to  maximize 
existing  and  planned  TWAES  functions.  Areas  which  appear  to  require 
support  efforts  Include  the  timely  reporting  and  assessment  of  events 
by  umpire  personnel,  the  structure  and  nature  of  the  post-exercise 
debriefing,  and  the  content  of  data  printouts  supporting  the  debrief. 
Observations  of  the  Modern  Army  Selected  System  Test  Evaluation  and 
Review  System  (MASSTER)  indicated  that  it  shares  similar  field  perfor¬ 
mance  evaluation  problems  with  TWAES  although  the  two  systems  have 
different  basic  objectives.  One  of  the  most  significant  differences 
between  the  systems  for  purposes  of  this  research  is  that  TWAES  oper¬ 
ates  in  real  time  whereas  MASSTER  does  not. 

The  research  literature  overall  is  not  consistent  and  substantive 
in  the  performance  areas  of  importance  to  TWAES.  The  literature 
contains  numerous  references  to  performance  evaluation  systems  designed 
for  highly  specific  situations,  but  these  generally  are  neither  suf¬ 
ficiently  objective  nor  compatible  with  field  environments.  The  more 
objective  approaches  involve  sophisticated  statistical  techniques 
and/or  extensive  simulation  efforts.  There  are  some  subjective  tech¬ 
niques  for  deriving  human  performance  predictors  and  criteria  which 
may  be  relevant.  Among  these,  the  Delphi  technique — a  systematic 
means  of  extracting  expert  opinion — appears  to  be  adequately  qualified 
in  terms  of  validity  and  practicality  for  application  to  TWAES. 
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Considerable  information  on  personal  backgrounds,  attitudes,  and 
physiological  measures  is  available,  but  does  not  appear  to  be  of 
immediate  utility  to  TWAES.  Conversely,  the  relatively  more  sparse 
literature  on  organizational,  situational,  and  evaluative  factors 
appears  to  be  more  readily  applicable  to  TWAES  requirements. 

Conclusions  and  Recommendations 


The  literature  dees  not  contain  substantive  research  studies  defin¬ 
ing  hunan  performance  assessment  methods  and  criteria  suitable  for 
direct  application  to  TWAES.  The  literature  does,  however,  contain 
studies  that  will  be  of  use  in  initiating  and  structuring  the  research 
in  this  area.  Organizational,  situational,  and  evaluative  factors 
all  hold  promise  as  potential  sources  of  performance  effectiveness 
measures  along  with  the  use  of  Delphi-type  approaches  for  the  devel¬ 
opment  of  interim  methods  ara  criteria. 
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SURVEY  OF  UNIT  PERFORMANCE  EFFECTIVENESS  MEASURES 
I.  Background 

This  survey  investigation  was  conducted  as  an  initial  phase  of  a 
reseaich  effort  undertaken  in  support  of  a  Marine  Corps  requirement  for 
improved  unit  and  individual  performance  measures  to  be  used  with  the 
Tactical  Warfare  Analysis  and  Evaluation  System  (TWAES) .  TWAES  is  a 
computer-based  system  designed  to  improve  control  of  Marine  Corps  field 
exercises  and  thereby  improve  the  training  engendered  by  the  exercises. 
Considerable  informative  feedback  from  field  exercises  is  processed  and 
available  for  playback  by  TWAES,  but  new  evaluation  approaches  and  criteria 
are  needed  to  provide  meaningful  assessment  of  performance  to  the  trainers. 
Improved  measures  of  effectiveness  and  performance  standards  for  field 
units  would  provide  estimates  of  combat  readiness  and  provide  the  basis 
for  the  establishment  of  training  objectives.  An  informational  survey 
was  needed  as  a  research  prerequisite  in  order  to  determine  the  state- 
of-the-irt  with  respect  to  existing  assessment  systems  and  methodologies 
so  that  decisions  regarding  the  appropriate  research  approaches  could 
be  made  with  knowledge  of  feasible  alternatives  and  research  options. 

To  the  extent  that  the  present  research  problem  is  representative  of  a 
broad  range  of  ot::er  criterion  and  measurement  problems,  the  present  survey 
\.  should  provide  coenific  data  and  general  information  of  value  in  solving 
\  similar  problems  in  other  contexts. 

II.  Approach 

A  two-fold  approach  was  used  to  determine  the  personnel  research 
requirements  needed  to  support  the  TWAES  in  the  evaluation  of  individual 
and  unit  performance.  A  concurrent  effort  was  undertaken  to  review  the 
literature  in  the  area  and  to  determine  the  state-of-the-art  in  existing 
related  systems.  The  approach  taken  in  these  two  efforts  is  described 
below. 

A.  Technical  Search 


The  development  of  the  specialized  expertise  required  for  the  conduct 
of  the  TWAES  project  was  accomplished  through  the  following  efforts', 
involvement  in  Karine  Corps  field  exercises;  detailed  examination  of 
similar  existing  systems;  and  attendance  at  and  participation  in  technical 
conferences  pertinent  to  the  technical  requirements  of  TWAES.  Additional 
information  was  collected  through  interviews  with  cognizant  Marine  Corps 
personnel  and  with  personnel  from  the  Naval  Electronics  Laboratory  Center 
(NELC),  San  Diego,  who  are  assigned  to  hardware  and  software  aspects 
of  the  system. 

B.  Literature  Search 


The  basic  sources  of  the  literature  survey  we/u  psychological  abstracts 
(1963-1^7?)  and  Defense  Documentation  Center  bibliographic  searches.  Ad¬ 
ditional  sources  included  publications  from  mili..ary  and  civilian  research 
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centers,  TopLC  areas  included  such  obviously  relevant  areas  as  unit  and 
individual  performance,  performance  evaluation,  decision  making,  and 
training.  Also  included  were  a  number  of  less  directly  related  topic 
areas  such  as  economic  and  technological  forecasting  in  order  t.o  include 
coverage  of  secondary  aspects  of  the  problem  area  and  to  insure  that 
potentially  critical  factors  were  not  overlooked. 

The  results  of  the  literature  survey  are  presented  in  narrative  form 
in  the  body  of  the  report  and  also  as  an  annotated  bibliography.  The 
narrative  references  in  the  body  of  the  report  are  necessarily  terse  and 
provide  only  an  indication  of  the  general  topic  area.  A  more  complete 
desct  .ption.  of  the  methodologies  and  results  of  each  report  is  provided 
by  referring  to  the  annotated  bibliography.  Although  a  number  of  studies 
were  found  to  be  relevant  to  military  performance  evaluation  in  general, 
the  available  literature  on  individual  and  unit  performance  evaluation 
methodologies  directly  applicable  to  the  requirements  of  TWvES  is  limited. 
There  is  a  particular  shortage  of  objective,  quantitative  methodologies 
available  for  application  in  field  exercise  environments.  For  tne  purposes 
of  this  summarization,  the  available  performance  related  literature  was 
broken  down  into  six  performance  related  areas:  Evaluation,  Simulation, 
Training,  Situational  Factors,  Organizational  Factors,  and  Biographical 
Factors.  The  area  of  Evaluation  is  concerned  with  methodologies  and 
techniques  for  standardizing  and  evaluating  human  performance  both  indi¬ 
vidually  and  in  groups.  The  Simulation  literature  contains  studies 
on  war-games,  strategy  selection,  equipment  simulators,  and  attempts 
to  validate  war-game  and  battle  simulations  against  historical  combat 
performance  data.  The  Training  references  refer  primarily  to  the  effects 
of  various  training  strategies  on  eventual  performance  and  the  development 
of  training  courses.  The  Situational  area  contains  references  to  work 
related  situational  stress,  fatigue,  informational  load,  and  isolation 
factors.  This  area  also  has  considerable  data  relating  to  decision  making. 
The  Organizational  area  contains  research  on  group  structure,  interaction 
patterns,  management,  and  leadership  factors  that  affect  performance. 

The  Biographical  area  contains  studies  on  anxiety,  personal  history, 
and  physiological  factors  which  are  predictive  of  performance,  primarily 
at  the  individual  level. 


III.  Discussion 


A.  Technical  Search 


1.  TWAES .  Pursuant  to  the  requirements  of  the  TWAES  project, 
personnel  from  this  Center  acted  as  observers  in  a  Marine  Amphibious 
Brigade  Landing  Exercise  (HABLEE)  at  Camp  Pendleton  in  January  1973. 

During  this  exercise  and  during  discussions  with  Marine  Corps  personnel, 
note  was  made  of  several  problems  associated  with  the  use  of  TWAES  in 
field  exercise  environments.  Difficulties  were  noted  in  the  lack  of  timely 
reporting  of  events  via  the  Digital  Message  Entry  Devices  (DM ED)  in  certain 
situations  and  in  the  accurate  assessment  of  performance  events  by  umpire 
personnel.  Part  of  the  total  problem  is  associated  with  technical  aspects 
of  the  equipment  and  is,  therefore,  not  primarily  within  the  area  of 
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research  responsibility  of  the  Wavy  Personnel  Research  and  development 
Center  (NPRDC) .  Another  part  of  the  problem  derives  from  the  difficulty 
inherent  in  the  measurement  of  complex  human  performance  in  a  field 
environment. 

Additional  areas  of  difficulty  were  noted  in  the  post-exercise  de¬ 
briefing  session.  The  training  related  aspects  of  the  interaction  between 
the  unit  staff  being  debriefed  and  the  controllers  performing  the  debrief 
require  further  definition.  This  will  be  required,  in  part,  to  determine 
whether  the  debrief  should  be  an  integral  part  of  the  exercise,  and  as 
such  is  basically  a  training  vehicle,  or  whether  it  is  in  fact  a  "pcst- 
exercise"  debrief  and  as  such  is  simply  an  informational  briefing  fol¬ 
lowing  the  exercise.  If  the  purpose  of  the  debrief  is  training,  there 
must  be  either  implicit  or  explicit  evaluative  judgements  concerning 
the  events  and  decisions  which  occurred  during  the  exercise.  That  is, 
the  training  function  requires  recognition  of  criterion  goals  in  order 
that  the  desired  behavior  or  skills  will  be  engendered  by  the  exercise. 

The  debriefing  in  turn,  may  then  provide  an  additional  opportunity  for 
evaluating  unit  and  individual  performance  data  that  may  have  been  over¬ 
looked  during  the  actual  exercise.  If  the  debrief  is  not  intended  as 
a  part  of  the  training  exercise  phase,  its  structure  can  be  modified 
accordingly. 

Another  aspect  amenable  to  improvement  is  concerned  with  tne  TWAES 
computer  data  printouts  and  with  the  application  of  those  printouts  to 

debrief  activity.  Presently  the  content  of  these  printouts  is  composed 
almosi  entirely  of  the  data  that  are  needed  to  control  and  monitor  the 
field  ex.  -else  rather  than  data  designed  for  performance  evaluation  pur¬ 
poses.  As  a  consequence,  the  printouts  do  not  readily  support  the  debrief 
activity.  This  problem  is  further  confounded  by  the  need  to  determine 
whether  tb  •  printouts  should  support  the  debrief  per  se  or  should  be  for 
use  by  the  uni*  commanders  in  preparing  future  training  plans.  In  short, 
a  determination  must  be  made  of  what  is  needed  by  whom  and  at  what  time. 

The  environment  inside  the  TWAES  control  van  during  the  exercise  is 
conducive  neither  to  operational  effectiveness  nor  personal  comfort. 

Very  high  noise  levels  were  in  evidence  during  the  January  1973  MABLEX. 

This  appeared  to  be  the  result  of  unsquelched  communications  sets  being 
operated  with  speakers,  and  also  due  to  controllers  having  to  share  or 
cross-utilize  communications  sets. 

The  questions  of  where  and  how  unit  performance  data  should  impact 
on  the  TWAES  system  also  requires  careful  consideration.  The  data  might 
be  impacted  in  real  time  by  means  of  the  DMFi)s.  If  so,  additional  codes 
for  the  DMEDs  may  be  required.  Additionally,  if  the  data  were  to  impact 
in  real  time  on  the  TWAES  firepower  models  and  calculations,  suitable 
modifications  of  those  models  would  have  to  be  coordinated  with  HELC 
personnel.  It  is  highly  desirable  that  the  data  impact  in  real  time  and 
in  che  firepower  calculation  so  that  troop  perforpiar.ee  will  have  an  effect 
on  the  outcome  of  every  battle  during  an  exercise.  If  luis  is  accomplished 
the  "reward"  for  a  high  level  of  performance  during  an  exercise  and  during 
actual  combat  will  be  more  similar  tiian  at  present. 
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If  the  data  ware  not  to  impact  in  real  time,  means  of  entering  the 
data  into  the  system  periodically,  or  perhaps  only  at  the  debriefing, 
would  have  to  be  developed.  Ihis  alternative  is  less  desirable  than  the 
former,  but  would  be  easier  to  accomplish  and  may  be  necessary  as  an 
interim  measure. 

2.  MASSTER  Modern  Army  Selected  System  Test  Evaluation  and  Review 
(MASSTER)  at  Fort  Hood,  Texas,  performs  equipment,  organizational  struc¬ 
ture,  and  concept  testing  for  the  U.  S.  Army.  A  review  of  that  system 
indicates  that  it  shares  certain  evaluative  problems,  if  not  features, 
with  TWAES.  MASSTER  attempts  to  evaluate  weapons  systems  by  employing 
a  combination  of  checklists,  associated  iogic  trees,  and  expert  judges 
in  the  field  environment. 

The  checklist-logic  tree  evaluation  utilizes  field  observers  to  check 
off  the  units'  performance  in  specified  situations.  The  list  is  inherently 
weighted  by  the  design  of  the  logic  tree  and  a  unit  passes  or  fails  pro¬ 
gressively  larger  performance  tests  as  a  result  of  their  performance  at 
the  individual  and  small  unit  level  in  building  block  fashion.  MASSTER 
also  assigns  officers  to  subjectively  evaluate  large  units  during  an 
exercise.  These  officers  must  meet  certain  experience  requirements, 
including  having  commanded  a  similar  unit,  before  being  selected  for  these 
assignments.  Typically,  these  are  senior  field  grade  officers.  These 
officers,  used  as  expert  judges,  are  authorized  to  overrule  the  results 
of  the  checklist  evaluation  if  they  feel  it  necessary.  While  MASSTER 
planners  would  prefer  the  system  to  be  more  objective  and  quantitative, 
they  feel  the  state-of-the-art  requires  this  compromise  at  the  present 
time. 

Data  from  MASSTER  is  not  reported  on  a  real-time  basis.  Rather,  it 
is  collected  daily  in  the  form  of  booklets  and  is  analyzed  after  the 
exercise  is  completed.  In  some  cases,  a  period  of  several  months  elapses 
before  the  analysis  is  completed.  This  time  lag  is  compatible  with  the 
purposes  of  MASSTER  but  it  would  not  be  acceptable  for  TWAES  purposes. 

B.  Literature  Search 


1.  Evaluation.  The  research  literature  in  the  performance  eval¬ 
uation  area,  although  variable  in  quality,  contains  a  number^  of  methods 
of  potential  utility  for  TWAES  research.  The  literature  of  interest 
includes  the  areas  of  peer  ard  supervisor  performance  evaluation,  observer 
checklist  evaluations,  multivariate  analysis  approaches,  and  subjective 
evaluation  techniques  involving  Delphi. 

Research  reported  by  Welson  and  Berry  (1966)  indicated  that  peer  and 
supervisor  evaluations  tend  to  reflect  different  abilities.  Supervisors' 
ratings  of  military  personnel  tend  to  measure  the  individual's  technical 
competence  whereas  peer  ratings  tend  to  measure  adherence  to  organizational 
guidelines.  Lackey,  Olmstead,  and  Christensen  (1972)  found  that  battalion 
commanders  and  company  commanders  have  differing  expectations  as  to  how 
offices  in  each  of  those  positions  should  exercise  leadership.  These 
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findings  have  ramifications  for  performance  evaluation  during  field  exer¬ 
cises  to  the  extent  that  these  role  expectations  and  criteria  differ 
at  the  two  differsnt  leadership  levels. 

The  :e  are  a  number  of  performance  evaluation  methods  that  have  been 
designed  for  specific  applications.  Among  Lhose  is  a  study  by  Dunlap 
and  Associates  (1966)  that  was  conducted  for  the  Army  in  the  area  of 
chemical  warfare.  This  effort  was  concerned  with  team  testing  techniques 
and  focused  on  recording  observable  behavior  and  team  interactions. 

No  direct  measures  of  mission  success  were  incorporated  in  the  study. 

This  type  of  study  does,  however,  have  relevance  for  TWAES.  Additional 
team  testing  methods  for  use  with  armored  units  are  reported  by  Cook  and 
Baker  (1968)  who  divided  evaluation  into  three  areas:  individual,  squad 
and  section,  and  intact  platoon.  Engel  (1970)  also  has  reported  work  with 
classification  systems  in  the  area  of  performance  assessment.  Linder, 
Smith,  Grover,  Morrissey,  and  Allen  (1969)  have  reported  on  performance 
measurement  techniques  for  use  with  individuals  in  combat  situations. 

This  report  also  contains  a  discussion  of  the  requirements  necessary  for 
performance  evaluation  that  is  relevant  to  TWAES  requirements.  All  of 
these  studies  have  at  least  tangential  impact  for  TWAL'S. 

A  report  by  Chesler  (1971)  presents  a  broad  methodological  approach 
for  development  of  computer-assisted  evaluation  of  trainee  performance 
in  a  simulation  environment.  The  research  emphasized  Navy  anti-air 
warfare  instruction,  but  may  have  applications  to  other  computer-based 
training  environments.  A  further  report  by  the  same  author  (1972) 
summarizes  the  previous  work  and,  additionally,  describes  in  detail 
an  attempt  to  automate  the  collection  of  performance  data  and  also 
details  the  problems  inherent  in  allowing  hardware  development  to 
proceed  ahead  of  consumer  utilization  procedures. 

Research  reported  by  McQuire  (1968)  concerning  the  determination  of 
success  related  combat  factors,  appears  of  considerable  potential  impor¬ 
tance  to  TWAES.  This  research  used  a  multivariate  statistical  analysis 
of  past  combat  engagements  to  factor  out  relevant  criteria  which  in  turn 
can  be  stressed  and  observed  in  field  exercises.  This  is  'ne  of  the  few 
attempts  to  validate  performance  criteria  against  real  cr«L-.  data.  In 
another  study  by  Prunkl  and  Boyles  (1968;,  62  Vietnam  were 

studied  to  gain  data  on  effective  and  ineffective  aeri^^^wmbac  perfor¬ 
mance.  k 

The  use  of  Delphi  related  techniques  to  derive  unit  performance 
criteria  appears  to  be  of  considerable  value  in  meeting  initial  TWAES 
requirements.  Research  by  Dalkey  (1968),  Helmer  (1967),  and  Beach  (1972) 
all  provide  methodologies  and  experimental  information  applicable  to 
the  measurement  aspects  of  TWAES.  The  Delphi  technique — a  systematic 
technique  for  the  extraction  of  expert  opinion — may  be  used  to  extract 
subjective  indicators  of  unit  performance  fiom  senior  Marine  Corps  per¬ 
sonnel.  These  indicators,  after  further  identification  and  definition 
by  the  Delphi  process,  could  then  be  used  in  field  exercises  by  less 
experienced  evaluators. 
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2.  Simulation.  Insight  into  the  factors  contributing  to  success¬ 
ful  combat  performance  has  been  facilitated  by  simulation  technology. 

While  the  TWAES  program  itself  is  not  a  simulation,  toe  following  studies 
are  included  to  provide  a  general  overview  of  simulation  related  perfor¬ 
mance  measures  in  an  attempt  to  indicate  those  measures  of  effectiveness 
which  might  be  more  extensively  examined  through  simulation. 

Dalkey  (1967)  discussed  simulations  developed  by  the  Rand  Corpor¬ 
ation  and  presented  the  common  characteristics  of  simul  tions.  This 
article  also  detailed  four  uncertainties  of  weapons  systems  analysis 
(stochastic;  epistemic;  strategic;  and  axiological)  that  may  be  of  use 
in  TWAES  related  research.  The  human  factors  input  to  simulation  systems 
was  studied  by  Arima  (1969).  Arima  contended  that  it  is  doubtful  that 
an  experimental  weapon  system  evaluation  can  duplicate  the  conditions 
of  real  combat.  In  essence,  it  is  difficult  to  motivate  individuals  to 
perform  realistically,  so  incentives  and  rewards  are  offered  as  alter¬ 
natives  to  increase  authenticity.  But  even  the  best  ’’training"  incentives 
are  different  than,  and  probably  have  much  less  impact  than,  the  incen¬ 
tives/punishments  of  combat.  The  individual  is  also  the  focus  of  a  paper 
by  liaker  (1972)  where  a  simulation  is  proposed  that  would  yield  measures 
of  system  performance  under  different  mixes  of  equipment.,  personnel,  and 
pre cedures. 

Another  simulation  model  was  provided  by  the  U.  S.  Army  Institute 
of  Advanced  Studies  (1967)  in  which  a  combat  model  for  maneuver  and 
firepower  analysis  was  described.  Although  unit  effectiveness  was  not 
discussed  directly,  Feldman  and  Simon  (1970)  described  a  study  in  which 
data  from  an  actual  battle  were  compared  with  data  from  the  same  battle 
simulated  on  a  computer.  The  number  of  people  killed  in  action  was  not 
significantly  different  between  the  actual  and  simulated  exercise, 
thereby  providing  one  measure  of  the  validity  of  the  simulation. 

The  evaluation  of  leader  effectiveness  is  an  involved  process  as  is 
shown  in  a  simulated  combat  study  by  Helme,  Willemin,  r.rd  Grafton  (1971). 
The  contribution  of  this  particular  study  stems  from  the  success  of  the 
simulation  tasks  in  identifying  specific  behaviors  descriptive  of  leaders 
in  combat.  The  input  of  various  leader  variables  does  not,  however, 
appear  to  be  particularly  useful  for  TWAES  at  this  time. 

3.  Training.  The  performance  of  a  unit  during  an  exercise  as 
evaluated  by  TWAES  and  the  unit  commander  is  in  a  practical  sense  an 
indication  of  previous  training  program  effectiveness.  The  following 
studies  present  information  relating  to  attitudes  during  training,  to 
training  program  requirements  and  methodology,  and  to  transfer  of  training. 

A  study  by  Clum,  Hoibcrg,  and  Kole  (1969)  showed  that  attitudes  toward 
the  military  and  toward  superior  officers  (Marine)  changed  in  a  negative 
direction  during  recruit  training.  Conversely,  a  study  by  Wilkins  (1967) 
found  that  a  Marine  recruit's  opinion  of  the  Corps  improved  during  train¬ 
ing.  Olmstead  (1968)  studied  824  basic  rifle  marksmanship  trainees  and 
concluded  that  "quick-kill"  training  increased  trainee  confidence  in 
the  firing  of  their  weapons.  This  study  did  not,  however,  measure  actual 
firing  performance. 
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A  paper  by  Hahn  and  Dayton  (1967)  presents  technical  training  evalu¬ 
ation  data  and  techniques  developed  around  U.  S.  Marine  Corps  courses. 
Methodologies  for  the  identification  of  the  relationship  of  training 
equipment  requirements  to  the  requirements  of  the  training  program  are 
discussed  by  Smith  (1965). 

A  number  of  studies  were  found  that  provided  training  methodologies 
and  experimental  evidence  of  successful  performance-related  training 
programs.  A  recent  investigation  by  Wheaton,  Mirabella,  and  Farina 
(1971)  showed  that  training  system  requirements  could  be  quantified. 

An  extensive  review  of  the  learning,  retention,  and  transfer  literature 
as  it  pertained  to  military  training  was  presented  by  Blaiwes  and  Regan 
(1970).  Hallstrtfm  (1969)  suggested  that  actual  combat  performance  could 
be  predicted  from  performance  exhibited  in  training.  This  work  was  based 
on  an  attempt  to  replace  the  concept  of  morale  with  auxiliary  concepts, 
and  is  of  potential  importance  to  TWAES.  George  (1967)  showed  that 
coordinative  responses  within  rifle  squads,  which  are  usually  learned  in 
combat,  could  be  learned  in  training  if  responsibility  for  coordinated 
action  were  taken  by  unit  members  rather  than  by  the  unit  leader. 

The  studies  reviewed  m  the  area  of  training  provide  a  number  of 
approaches  of  potential  value  for  the  purposes  of  TWAES. 

4.  Situational  Factors.  While  one  of  the  purposes  of  TWAES  is 
to  determine  potential  combat  performance  from  field  exercise  performance, 
a  thorough  knowledge  of  situational  variables  offers  insight  as  to  what 
moderates  this  performance.  The  following  studies  provide  information 
in  the  areas  of  performance  under  stress,  confinement,  continuous  opera¬ 
tions,  and  decision-making. 

Streufert  and  Streufert  (1972a)  under  contract  to  the  Office  of  IJaval 
Research,  presented  results  from  a  study  concerned  with  information 
processing  under  Truel  stress  (conflict  among  three  parties  without 
coalition  formation).  It  was  ahown  that  Truel  stress  subjects  believed 
they  had  received  more  information  than  they  could  meaningfully  respond 
to,  even  though  actual  relevance  of  the  information  did  not  increase. 

The  practical  implications  cf  these  findings  are  important.  Increased 
perception  of  relevance  under  these  conditions  not  only  produced  de¬ 
creased  performance  quality,  but  also  increased  the  probability  of  res¬ 
ponding  to  meaningless  information  (since  more  information  is  viewed 
as  requiring  more  responses).  Threat  oriented  and  task  oriented  subjects 
were  studied  under  high  arousal  levels  by  Bergstrom  and  Arnberg  (1971), 
who  found  that  the  performance  of  threat  oriented  subjects  decreased  more 
rapidly  than  for  task  oriented  subjects. 

Although  the  probability  is  low  that  an  individual  or  unit  would  be 
called  to  combat  performance  immediately  after  release  from  confinement 
and  isolation,  the  effects  of  these  conditions  upon  performance  are 
noteworthy.  Smith  and  Hay thorn  (1972)  studied  56  naval  enlisted  males 
in  groups  of  twos  and  threes  under  conditions  of  isolation  and  confinement 
for  a  period  of  21  days.  In  general,  the  data  suggest  th.it  performance 


would  vary  as  a  function  of  the  changes  in  behavior  manifested  by  the 
isolated  subjects  and  their  subjective  reactions  to  both  their  physical 
and  social  environment. 

Since  combat  units  periodically  participate  in  continuous  operations 
the  following  results  from  research  studies  concerning  sustained  perfor¬ 
mance  are  of  relevance  to  TWAES .  Hodge  (1972)  presented  a  series  of 
papers  that  discuss  the  task,  environmental,  and  nutritional  variables 
affecting  man's  ability  to  perform  for  long  periods  of  time.  Harris  and 
O'Hanlon  (1972)  reviewed  113  studies  in  an  attempt  to  predict  behavioral 
and  biological  impairments  which  might  result  from  continuous  operations 
and  to  determine  whether  the  period  necessary  for  recovery  following  a 
sustained  operation  could  be  ascertained.  While  their  objectives  were 
not  fully  achieved  by  the  investigative  review,  the  data  did  suggest 
that  severe  impairments  may  be  experienced  by  soldiers  engaging  in  con¬ 
tinuous  operations.  A  field  experiment  with  tank-crews  by  Ainsworth 
and  Bishop  (1972)  showed  that  continuous  '48-hour  operations  can  be  accom¬ 
plished  without  changes  in  existing  unit  organization  or  doctrine.  Banks, 
Steinberg,  and  Farrel  (1970)  found  similar  results  in  a  study  with  military 
personnel  engaged  in  a  44  hour  continuous  operation. 

Extensive  experimentation  has  been  conducted  by  Streufert  and  Streufert 
(1968b,  1970,  1972b)  in  the  area  of  decision-making.  They  have  demon¬ 
strated  that  risk-taking  increases  with  the  length  of  time  the  decision¬ 
making  group  spends  on  a  task.  Furthermore,  risky  decision-making  becomes 
concentrated  in  one  decision  area  at  a  time,  even  though  risks  could  be 
taken  in  more  areas.  Results  from  an  experimental  simulation  by  Streufert 
and  Streufert  (1968a)  also  indicated  that  risk-taking  increased  with 
continued  participation  in  a  decision-making  task  and  that  optimal  deci¬ 
sion-making  quality  occurred  at  loads  of  10  or  12  independent  items 
received  by  decision-makers  per  one-halt  hour. 

5.  Organizational  Factors.  An  examination  of  the  organizational 
factors  literature,  as  referenced  in  the  Appendix,  confirms  the  assumption 
that  the  performance  of  a  group  is  a  function  of  various  organizational 
variables  (Davis,  1969).  The  literature  review  in  this  area  indicates 
that  leadership,  group  processes,  productivity,  structure,  and  the  work 
environment  itself  are  of  relevance  to  TWAES. 

For  example,  Lange  (1967)  described  studies  which  indicated  that  the 
leader  is  the  most  important  variable  in  terms  of  facilitating  perfor¬ 
mance.  Eons,  Bass,  and  Komorita  (1970)  found  that  leadership  style  will 
change  as  a  function  of  command  and  previous  type  of  command  experience. 
O'Brien  (1970)  in  a  study  with  Australian  Army  soldiers,  reported  that 
leader  effectiveness  depends  upon:  (1)  the  personal  attributes  and  rank 
of  the  leader;  (2)  the  quality  of  leader-member  interpersonal  relations; 
and  (3)  the  kind  of  group  task. 

Thu  latter  two  variables  were  examined  by  Springer  0971)  in  a  study 
of  military  basic  trainees  and  pi;. toon  drill  sergeants.  It  was  shown 
that  there  is  sometimes  a  difference  between  the  attitudes  of  superiors 
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and  subordinates  toward  the  legitimacy  of  supervisory  influences  under 
certain  conditions  and  that  these  differences  seem  to  be  related  to  the 
work  environment.  Also,  in  reference  to  attitudes,  a  study  by  Nelson 
(1968)  reported  that  the  cohesiveness  of  Marine  basic  training  platoons 
was  relatively  stable  over  a  two  month  period,  but  it  was  uncorrelated 
with  performance  measures,  although  it  was  related  to  personnel  compo¬ 
sition  and  attitudes. 

A  number  of  studies  indicated  that  an  understanding  of  performance 
can  be  facilitated  when  consideration  is  given  to  certain  group  variables. 
The  individuals  that  compose  a  group  will  often  vary  in  their  conceptual 
level  with  subsequent  variations  in  structuring,  functional  role  certainty, 
and  decision-making  as  was  shown  by  Stager  (1966).  O'Brien  (1970)  also 
showed  that  the  group  task  affected  the  nature  of  the  perceived  group 
interaction,  group  productivity,  and  leader  effectiveness. 

Additional  research  in  decision-making  processes  was  done  by  Cockrell 
(1969).  Results  from  that  study  showed  that  team  consensus  feedback 
enhances  target  detection  in  field  units.  Stager  (1965)  also  studied 
decision-making  and  showed  that  the  cognitive  complexity  of  a  group  deter¬ 
mined  the  mode  of  operation  of  the  group. 

The  research  evidence  indicates  that  organizational  factors  do  impact 
on  performance  in  military  units.  To  the  extent  that  contributory  factors 
can  be  identified  and  reliably  measured  under  field  exercise  conditions, 
they  may  provide  useful  performance  measures  for  TWAES. 

6.  Biographical  Factors.  The  general  area  of  biographical  factors 
contains  references  on  intelligence,  anxiety,  personal  history,  and  phys¬ 
iological  factors  which  may  impact  on  performance.  Among  the  studies 
referring  to  leadership  in  this  area  are  findings  by  Csoka  and  Fiedler 
(1972)  that  indicate  that  the  correlation  between  leader  intelligence 
and  group  performance  is  low. 

Most  of  the  studies  relating  anxiety  to  performance  have  only  marginal 
relevance  to  immediate  TWAES  requirements.  Research  by  Cium  and  Mahan 
(1971)  and  Datel  and  Lifrak  (1969)  was  conducted  on  basic  training  re¬ 
cruits.  Studies  by  Bourne,  Coli  and  Datel  f lyC 8)  and  Strange  (1968)  were 
conducted  in  combat  environments  but  their  results  are  clinically  oriented 
and  not  of  apparent  relevance  to  TWAF.S.  Similarly,  personal  history 
studies  relating  to  performance  such  as  those  by  Berry  and  Nelson  (1966) 
and  Mahan  and  Clum  (1971)  are  of  primary  value  in  terms  of  personnel 
selection  systems.  The  physiological  studies  by  Arthur  (1971);  Carver 
and  Winsmann  (1970);  and  Srivastava  (1968)  are  concerned  wife  performance 
only  from  a  medical  point  of  view.  In  summation,  those  biographical 
factors  reviewed  do  not  provide  sources  of  performance  measures  or  pre¬ 
dictors  readily  applicable  to  Marine  Corps  requirements  on  TWAES. 

IV.  Conclusions  and  Recommendations 


While  the  literature  does  not  provide  the  well-defined  and  uniform 
coverage  of  individual  and  unit  performance  measures  needed  to  support 
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TWAES,  it  does  contain  studies  from  many  areas  that  are  of  value  as  points 
of  departure  for  further  research.  For  example,  the  literature  concerning 
situational  and  organizational  determinants  of  performance  appear  parti¬ 
cularly  relevant  to  the  requirements  of  TWAES.  The  differential  effects 
of  situational  variables  and  their  interaction  with  organizational 
variables  may  provide  one  valid  conceptual  basis  for  developing  measures 
of  effectiveness. 

Literature  from  the  training  area  contains  studies  on  the  evaluation 
of  morale  through  the  use  of  auxiliary  concepts  and  also  provides  perti¬ 
nent  studies  on  the  evaluation  of  unit  coordination.  Both  of  these  areas 
have  potential  application  to  TWAES.  Further  research  into  the  warfare 
simulation  area  also  appears  warranted.  The  large  amount  of  data  that 
can  be  rapidly  generated  and  the  wide  range  of  potential  predictor  vari¬ 
ables  that  can  be  simultaneously  manipulated  make  this  an  area  of  impor¬ 
tance.  Delphi  approaches  are  indicated  in  the  evaluation  literature  to 
be  reliable  initial  sources  of  performance  measures.  As  an  interim  method, 
the  Delphi  approach  appears  to  be  acceptable  in  terms  of  both  theoretical 
and  practical  considerations.  For  the  long  terra,  thesn  subjective  methods 
would  be  supplanted  by  more  sophisticated  quantitative  measures  as  they 
are  developed  and  validated.  Observations  of  MASSTER  at  Fort  Hood,  Texas, 
confirm  this  view.  MASSTER  u/ilizes  a  large  subjective  element  in  its 
evaluative  process  at  present  to  complement  its  objective  procedures, 
not  by  choice,  but  rather  by  necessity.  More  objective  techniques  will 
be  utilized  as  they  are  developed  and  validated.  In  the  interim,  however, 
MASSTER  combines  both  subjective  and  objective  techniques  to  utilize  the 
strengths  of  each  in  meeting  an  immediate  requirement. 

In  summation,  the  available  literature  and  existing  system",  as  anti¬ 
cipated,  do  not  provide  any  ready  solution  to  the  performance  evaluation 
requirements  of  TWAES.  These  sources  do,  however,  provide  diverse  infor¬ 
mation  concerning  experimental  methodologies,  experimental  results,  and 
theoretical  concepts  which  can  he  utilized  in  the  development  of  effec¬ 
tiveness  measures  and  procedures  for  TWAES. 
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was  found  more  useful.  "...  this  model  can  help  judges 
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(Research  Report  SRR  71-25) 

This  report  prop' aes  a  six-step  methodological  approach  for 
computer  assisted  evaluation  of  man-machine  performance  as  found 
in  the  Tactical  Advanced  Combat  Direction  and  Electronic  Warfare 
(TACDEW)  system.  The  suitability  of  the  proposed  methodology  is 
discussed  in  terms  of  applications  to  other  areas  (e.g.,  multi-team 
(CIC)  anti-air  warfare;  carrier  controlled  approach;  and  surface 
maneuvers  (radar  navigation). 

3.  Chesler,  David  J.  Application  and  utilization  of  training  aids 
and  devices:  Simulated  exercises  and  trainee  performance  evalu¬ 
ation.  San  Diego:  Naval  Personnel  &  Training  Research  Laboratory, 
September  1972.  (Research  Report  SRR  73-7) 

This  report  presents  a  detailed  description  of  an  attempt  to 
accomplish  real-time  performance  evaluation  on  the  Tactical  Advanced 
Combat  Direction  and  Electronic  Warfare  (TACDEW)  system.  The  account 
emphasizes  the  numerous  difficulties,  both  technical  and  administra¬ 
tive,  Inherent  in  attempts  to  apply  computer-assisted  evaluation 
techniques  to  complex  simulation  systems. 

A.  Cook,  J.  G.,  £.  Baker,  R.  A.  Armored  infantry  platoon  training 
and  evaluation.  HumRRO  Professional  Paper,  1968,  No.  28-o8. 

Presents  research  in  training  methods  and  techniques  for 
improving  combat  readiness  of  the  armored  cavalry  platoon. 

Criteria  to  evaluate  the  combat-ready  status  of  units  are 
established  through  a  readiness  check.  A  tactical  training 
method  bridging  the  gap  between  classroom  and  field  is  also 
described 
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Dalkey,  U.  C.  Predicting  the  future.  Santa  Monica,  California: 

Rand  Corporation,  October  1968. 

Presents  a  description  of  the  Delphi  Method.  The  group  is 
not  asked  to  arrive  at  a  common  opinion.  Rather,  the  group 
opinion  is  the  statistical  average  of  the  final  opinions  of 
individual  members  of  the  group. 

Dunlap  &  Associates,  Inc.  Performance  measures  for  human  factors 
engineering  evaluation  of  EARL  equipment.  Edgewood,  Maryland: 
Prepared  for  Edgewood  Arsenal  Research  Laboratories,  SSD66-332(ol8) 
June  1966. 

A  report  on  an  attempt  to  develop  standard  tactical  team 
testing  techniques  for  U.  S.  Army  use  in  CBR  (NBC)  environments. 
Broad  literature  search  included,  along  with  an  emphasis  on 
recording  observable  behavior  and  team  interactions,  application 
of  video  tape,  film,  observers,  and  on  physiological  measures. 

Direct  measures  of  mission  success  were  not  used. 

Engel,  J.  D.  An  approach  to  standardizing  human  performance  assess¬ 
ment.  HumRRO  Professional  Paper,  October  1970,  No.  26-70. 

Presents  an  approach  to  standardizing  performance  assessment 
that  concentrates  on  two  critical  areas  and  the  relationship 
between  them:  (a)  a  task  classification  system;  and  (b)  a  per¬ 
formance  measure,  or  criterion  classification  system. 

Helmer,  0.  Analysis  of  the  future:  The  Delphi  Method.  Santa 
Monica,  California:  Rand  Corporation,  P-3553,  March  1967. 

Defines  Delphi  technique  as  an  "attempt  co  make  effective 
use  of  informed  intuitive  judgement."  it  makes  use  of 
the  insight  of  experts  as  systematically  as  possible.  It 
is  admittedly  a  stop-gap  measure.  It  eliminates  a  commit¬ 
tee  among  the  experts  and  replaces  it  with  a  program  of 
sequential  individual  interrogations  (usually  done  by 
questionnaires)  interspersed  with  information  and  opinion 
feedback. 

Riesler,  C.  A.  The  psychology  of  commitments;  experiments  linking 
behavior  to  belief.  New  York:  Academic  Press,  1971,  166-167. 

Presents  an  attitude  change  study.  It  condones  that  if 
you  let  people  decide  if  a  relevant  concern  shot  Id  Le  changed, 
you  may  not  succeed.  If,  on  the  other  hand,  you  let  people 
decide  how  the  change  is  to  be  implemented  you  may  gain  cooperation. 

Lackey,  L.  L.,  Olmstead,  J.  A.,  6  Christensen,  !!.  E.  The  effect 
of  command  position  upon  evaluali  .ns  of  leader  behavior.  HumRRO 
Technical  Pveport,  November  1972,  ;Jo.  77-32. 


Study  indicates  that,  "Battalion  Commanders  do  not  differentiate 
between  command  levels  as  to  the  desirability  of  leader  actions. 
Company  Commanders  differentiate  between  command  levels  with  regard 
to  actions  concerned  with  centralization  of  authority  and  respon¬ 
sibility.  Company  Commanders  consider  decentralized  actions  to 
be  more  desirable  for  both  Battalion  Commanders  and  Company  Com¬ 
manders  than  do  Battalion  Commanders." 

11,  Linder,  W.  U. ,  Smith,  U.  G.,  Grover,  D.  E.,  Morrissey,  P.  A.,  & 
Allen,  R.  P.  Test  manual;  Measurement  of  incapacitation  with 
selected  infantry  skills.  Edgewood,  Maryland:  Department  of 
the  Army,  Edgewood  Arsenal  Research  Laboratories,  21910  EASP100- 
57,  June  1969. 

The  report  documents  research  on  individual  performance  at 
combat  tasks  while  under  the  effects  of  chemical  warfare  incapaci- 
tants.  It  contains  a  good  discussion  of  experimental  requirements 
for  performance  evaluation. 

12.  McQuire,  R.  Multivariate  analysis  of  combat.  Washington, 

i).  C.:  Planning  Research  Corporation,  PRC  R-1143,  July  1968. 

Provides  a  comprehensive  review  and  application  of  multivariate 
techniques  to  historical  combat  data  for  the  purpose  of  factoring 
out  the  relative  contributions  of  maneuver  and  firepower  to 
mission  success. 

13,  Nelson,  P.  D. ,  &  Berry,  II.  H.  Dimensions  of  peer  and  supervisor 
ratings  in  a  military  setting.  USN  MNRU  Report,  1966,  No.  6b-l. 

A  supervisor  rating  on  overall  adjustment  and  peer-group 
nominations  for  routine  work  assignments  and  a  hypothetical 
combat  situation  were  obtained  on  101  male  enlisted  Marines 
who  had  completed  two  years  of  military  service.  In  studying 
the  dimensions  of  such  evaluations,  trie  supervisor  rating 
appeared  to  reflect  primarily  the  S’s  technical  competence 
on  the  job  whereas  the  peer  nominations  tended  to  predominantly 
reflect  S's  conduct  or  capacity  for  adhering  to  the  organiza¬ 
tion's  rules  and  regulations. 

14.  Prunkl,  P.  R. ,  &  Boyles,  Wiley  R-  A.  A  preliminary  application  of 
the  critical  incident  technique  to  combat  performance  of  Army 
aviators.  HumRRO  Professional  Paper,  1963,  No.  24-68. 

Sixty-two  Vietnam  returnees  completed  a  critical  incident 
survey  in  which  they  described,  in  narrative  form,  their 
combat  reaction  r.r.v  those  of  other  pilots.  Incidents  of 
ineffective  behavior  occurring  in  the  air  and  on  ground 
were  categorized  using  R.  P.  Kern's  conceptual  model  of  be¬ 
havior  under  stress. 
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15.  Tetmeyer,  D.  C.  The  influence  of  partial  models  and  criterion 
measurement  scales  on  consideration  of  incommensurate  criterion 
variables  in  a  complex  decision.  Dissertation  Abstracts  Inter¬ 
national,  October  1970,  31(4-B) ,  2343. 

16.  Wolf,  C.,  Jr.  The  present  value  of  the  past.  Santa  Monica, 
California:  Rand  Corporation,  P-40t>7,  April  1969. 

This  study  may  have  importance  for  post  exercise  evaluative 
reviews.  This  approach  may  alter  the  outcome  of  evaluations  made 
during  the  exercise  based  on  more  complete  information  or 
subsequent  events. 

Simulation 

17.  Arima,  A.  K.  Human  factors  in  weapon  system  evaluation  (U). 

Fort  Ord,  California:  Litton  Scientific  Support  Laboratory, 
Technical  Paper  LSSL-TP-69-1,  1969. 

The  report  emphasizes  the  need  for  systems  under  evaluation 
to  be  stressed.  Care  must  be  taken  to  test  those  elements  of  a 
system  that  are  critical  to  the  system  being  evaluated  and  not 
simply  superficial  characteristics  of  the  combat  situation. 

18.  Biker,  J.  D.  Quantitative  modeling  of  human  performance  in  infor¬ 
mation  systems.  Arlington,  Va.:  Behavior  and  Systems  Research 
Laboratory,  Technical  Research  Note  232,  June  1972. 

Describes  an  information  system  model  which  focuses  on  man 
and  considers  the  computer  as  a  tool.  Links  human  performance 
implications  to  system  performance  as  cohesive  systems  based  on 
the  flow  of  data  through  both  man  and  machine. 

19.  Dalkey,  H.  C.  Games  and  simulations.  Santa  Monica,  California: 
Rand  Corporation,  April  1964. 

Presents  a  discussion  on  the  aoplication  of  game  theory  to 
military  analysis.  At  the  time  of  the  report  game  theory 
was  not  adequate  for  complex  tasks,  and  also,  many  military 
encounters  are  not  zero-sum.  The  concept  of  imbedded  models 
is  discussed  where  the  overall  or  aggregate  model  is  used  to 
provide  inputs  and  control  for  more  powerful  specific  models. 

20.  Dalkey,  N.  C.  Simulation  of  military  conflict.  Santa  Monica, 
California:  Rand  Corporation,  January  1967. 

The  article  classifies  simulation-,  according  to  size, 
formalization,  and  analyticity  characteristics.  It  discusses 
simulations  developed  by  Rand.  Four  uncertainties  in  weapons 
systems  analysis  are  discussed:  (1)  stochastic — where  events 
are  probabalistic;  (2)  epistenic — where  you  don't  have  enough 
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information  to  make  «  decision;  (3)  strategic — where  two  or 
more  independent  decision  makers  can  affect  an  outcome;  (A) 
axiological— where  there  is  no  well-defined  criterion  or  pay-off 
to  form  a  basis  of  evaluation. 

21.  Danielian,  J.f  &  Stewart,  E.  C.  New  perspectives  in  training  and 
assessment  of  overseas  personnel.  HumRRO  Professional  Paper,  1967, 
No.  6-67. 

Simulated  training  was  proposed  as  a  viable  means  for 
facilitating  the  cross-cultural  acclimation  of  military  per¬ 
sonnel  serving  overseas. 

22.  Feldman,  L.,  &  Simon,  S.  The  relation  of  the  tactical,  warfare 
simulation  program  (TWSP)  to  historical  welfare.  Arlington s 

Va. :  The  Center  for  Naval  Analyses,  Naval  Warfare  Analysis  Group, 
Studj  Ho,  6A,  VIII,  1970. 

Provides  detailed  description  of  the  comparison  of  three  TWSP 
simulations  with  historical  accounts  of  the  same  battles.  TWSP 
uses  the  Lanchester  laws  of  attrition  to  predict  casualties. 

The  report  does  not  discuss  unit  effectiveness. 

23.  Helme,  W.  H.,  Willemin,  L.  P.,  &  Grafton,  F.  C.  Dimensions  of 
leadership  in  a  simulated  combat  situation.  Arlington,  Va. : 

BESRL  Technical  Research  Report  1172,  July  1971. 

The  findings  strongly  sugge„'  that  the  total  simulation 
technique  can  yield  not  only  reasonably  objective  performance 
measures  taken  under  some  degree  of  stress,  but  can  also  con¬ 
tribute  to  better  evaluations  of  more  enduring  leadership 
qualities. 

24.  U.  S.  Army.  Assessment  of  combat  effectiveness.  Part  II — Final 
Report.  Carlisle  Barracks,  Pennsylvania:  U.  S.  Army  Combat 
Developments  Command,  Institute  of  Advanced  Studies,  February  1967. 

Provides  a  description  of  a  combat  model  for  maneuver  and 
fire  analysis.  The  model  is  deterministic  and  is  designed  for 
battalion-level  engagements. 

Train ing 

25  Clum,  G.  A.,  Hoiberg,  A.,  &  Kole,  D.  M.  Attitude  ebege  in  Marine 
recruit  training.  Psychological  Reports,  1969,  2A (1) ,  311-318. 

Presents  a  study  of  attitude  change  during  marine  basic  training. 
Attitudes  toward  superior  officers  and  the  military  in  general  were 
generally  found  to  change  in  a  negative  direction. 
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Blaj.wes,  A.  S.,  &  Regan,  J.  J.  An  integrated  approach  to  the  .study 
of  learning,  retention,  and  transfer:  A  key  issue  in  training 
device  research  and  development-  NAVTRADEVCHM  Technical  Report, 
August,  1970,  do.  Ill— 17 8 . 

Summarizes  the  approach,  rationale,  and  results  of  efforts  to 
acquire  information  on  learning,  retention,  and  transfer  applicable 
to  military  training  problems. 

Bourne,  P.  G.  Some  observations  on  the  psychosocial  phenomena  seen 
in  basic  training.  Psychiatry ,  1967,  HI (21 ,  187-196. 

This  is  psychiatric  study  concerned  with  the  transition  from 
civilian  to  military  life. 

George,  C.  E.  Training  for  coordination  within  rifle  squads. 

HumRRO  Professional  Paper,  1967,  No.  21-67,  36-44. 

Attempted  to  provide  a  basis  for  the  design  of  training 
that  would  facilitate  coordination  of  the  actions  of  unit  members 
by  shifting  some  of  the  responsibility  for  coordination  from 
leaders  to  tiie  unit  members  themselves. 

Gum,  D.  R. ,  &  Knoop,  P.  A.  Automated  input/output  diagnostics  for 
a  real  time  Simulation  Researcli  System.  USAF  AMRL  Technical  Report, 
1966,  No.  66-133,  v. 

Report  includes  description  of  a  real  time  simulation  as 
a  training  technique.  Describes  automated  diagnostic  test  programs 
for  real  time  input/output  section  of  a  digital  training  simulation 
research  system. 

Hahn,  C.  ?.,  &  Dayton,  C.  M.  A  guide  for  evaluating  formal  enlisted 
technical  training  programs  in  the  U.  S.  Marine  Corps.  American 
Institutes  for  Research  Report,  1967,  Ho.  R67-5. 

Describes  a  general  method  for  evaluating  technical  training 
programs  that  were  developed  around  U.  S.  Marine  courses. 

Hallstrom,  A.  G.  Stridens  psykiska  verkningar.  Ett  forsok  till 
modell  for  kvantitativ  uppskattning:  I.  (Psychological  effects 
in  combat.  An  attempt  at  shaping  a  model  for  evaluating  by  quantity 
I.)  MPI  B-Rapport,  October  1969,  No.  35. 

Describes  an  attempt  to  replace  the  concept  of  morale  by 
measurable  auxiliary  concepts.  The  theoretical  background  of 
investigations  attempting  to  predict  likely  performance  in  the 
field  on  the  basis  of  troop  performance  in  military  training  in 
peacetime  is  detailed. 
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32.  Hoehn,  A.  J.  Military  training  research  in  the  engineering  of 
training  programs  for  technical  personnel.  HumRRQ  Professional 
Paper,  1969,  No.  4-69. 

Describes  recent  advances  in  training  technology  directed 
toward  solving  training  and  manpower  problems. 

33.  Hunter,  K.  G.  Training  models:  I.  The  formulation  of  training 
problems.  HumRRQ  Professional  Paper,  3966,  No.  13-66,  1-8. 

Examines  a  chronology  of  functions  found  useful  in  estab¬ 
lishing  and  maintaining  effective  training  programs.  Problems 
in  the  formulation  of  military  training  are  discussed  and  areas  of 
research  for  increased  training  are  suggested. 

34.  McClelland,  W.  A.  HumRRO  research  on  officer  training. 

KumRRO  Professional  Paper,  September  1970,  No.  24-70. 

This  report  provides  an  overview  of  research  in  the  areas 
of  officer  training  and  leadership. 

35.  Olmstead,  J.  A.  The  effects  of  "quick  kill"  upon  trainee  confidence 
and  attitudes.  HumRRO  Technical  Report,  19b8,  No.  68-15. 

This  study  attempted  to  determine  the  effects  of  quick-kill 
training  on  the  confidence  and  attitudes  of  basic  combat  trainees 
toward  various  phases  of  basic  rifle  marksmanship  (BRM> ,  and  to 
obtain  information  on  drill  sergeants’  opinions  of  the  training. 

BRM  training  with  quick  kill  was  found  to  increase  trainee  confi¬ 
dence  in  ability  to  fire  the  service  weapon  significantly  more 
than  BRM  alone.  It  was  concluded  that  quick-kill  training  has 
a  positive  effect  on  trainee  confidence  and  attitudes. 

36.  Smith,  B.  J.  Task  analysis  methods  compared  for  application  to 
training  equipment  development.  Valencia,  Penn.:  Applied 
Science  Associates,  Inc.,  September  1965. 

A  "compare  and  contrast"  study  is  presented  on  various  approaches 
to  task  analysis  as  it  applies  to  the  identification  of  training 
equipment  requirements. 

37.  Ward,  J.  S.  A  case  study  of  the  development  of  an  individual 
combat  training  program.  HumRRO  Professional  Paper,  1967, 

No.  21-67,  20-27. 

Examines  problems  of  the  curriculum  designer  including 
(1)  validation  of  the  training  program,  (2)  dealing  with 
tradit ional  subjects  which  are  difficult  to  relate  to  an 
actual  performance  requirement,  and  (3)  differentiation  between 
training  realism  and  realistic  training.  The  development  of  a 
combat  training  program  is  outlined. 
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Wheaton,  G.  R. ,  Mirabella,  A.,  &  Farina,  A.  Trainee  and  instructor 
task  quantification:  Development  of  quantitative  indices  and  a 
predictive  methodology.  NAVTRADEVCEN ,  January  1971,  Report 
No.  69-C-0278-1. 


An  exploratory  study  was  undertaken  as  part  of  a  program 
tc  develop  quantitative  techniques  for  prescribing  the  design 
and  use  of  training  systems.  A  combi:,.- tion  of  task  and  training 
indices  were  found  to  predict  later  performance. 

39.  Wilkins,  W.  L.  Attitudes  and  values  as  predictors  of  military 
performance .  USN  Medical  Neuropsychiatric  Research  Unit  Report, 
1967,  No.  67-6,  276-282. 

Reports  outcomes  of  the  study  of  attitudes  of  Marines  in  basic 
training  as  related  to  later  ratings  of  military  adaptation. 
Results  indicate  that  a  Marine  Corps  recruit’s  judgment  of  the 
Corps  goes  up  during  recruit  training.  Attitude  items  related 
to  tue  rise  in  opinion  are  the  recruit’s  appreciation  for  the 
training  instruction,  the  discipline  enforced,  and  the  mutual 
rtspect  shown  by  the  officers  and  men.  It  is  concluded  that  via 
such  an  atmosphere,  a  majority  of  young  men  undergo  a  "dramatic, 
although  not  necessarily  permanent,  reformulation  of  life  goals 
and  values." 


Situational  Factors 


!40.  Ainsworth,  L.  L.,  &  Bishop,  H.  P.  Effects  of  48  hours  of  sustained 

field  activity  on  tank  crew  performance.  Proceedings  of  the  Annual 
Convention  of  the  American  Psychological  Association,  1972,  7(Pt.2), 
625-626. 

In  a  field  experiment  to  determine  effects  on  tank-crew 
performance  in  communication,  driving,  surveillance,  gunnery, 
jj  and  maintenance  tasks  of  sustained  activity,  it  was  shown 

that  continuous  48-hour  operations  can  be  accomplished  with¬ 
out  changes  in  unit  organization. 

41,  Banks,  J.  II.,  Steinberg,  J.  J.,  &  Farrell,  J.  P.  Effects  of  con- 
5  tinuous  military  operations  on  selected  military  tasks.  BESRL 

Technical  Research  Report,  1166,  AD  718253,  December  1970. 


It  was  shown  that  properly  motivated  soldiers  can  perform 
at  a  stable  level  with  no  loss  in  efficiency  on  combat  related 
tasks  during  a  44-hour  period  of  continuous  military  operation. 

42,  Bergstrom,  B.,  4  Arnberg,  P.  The  effect  of  threat-  and  task- 
oriented  attitude  upon  performance  under  stress.  Scandinavian 
Journal  of  Psychology,  1971,  12(1),  14-20. 
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Tracking  performance  and  arousal  level  were  studied  in  10 
Army  conscripts  who  were  threatened  with  electric  shocks.  Results 
showed  that  performance  deteriorated  more  for  Ss  who  were  threat- 
oriented. 

43.  Boyles,  W.  R.  Background  and  situational  confidence:  Their  relation 
to  performance  effectiveness.  HumRRO  Professional  Paper,  1968, 

'do.  22-68. 

Inventories  designed  to  measure  confidence  in  dangerous  situa¬ 
tions  were  administered  to  3000  potential  United  States  Army  aviation 
warrant  officers.  Relationships  of  scores  on  two  inventories 
(background  activities,  and  situational  confidence)  to  peer  ratings, 
attrition  during  flight  training,  and  accident  information,  are 
presented. 

44.  Farris,  W. ,  &  O’Kanlon,  J.  F.  A  study  of  recovery  functions  in  man. 
U.  3.  Army  Human  Engineering  Laboratories  Technical  Memorandum, 

April  1972,  No.  1C-72. 

Provides  a  review  of  the  literature  on  continuous  operations. 

The  data  suggest  that  certain  severe  impairments  may  be  experienced 
by  soldiers  engaged  in  sustained  and  continuous  operations. 

45.  Helrae,  W.  H.  Factor  analysis  of  a  situational  leadership  measure: 

The  Speeded  Practical  Judgment  Test.  U.  S.  Army  BESIIL  Technical 
Research  Note,  1968,  No.  202. 

Study  attempted  to  validate  the  experimental  measures  of  the 
Differential  Officer  Battery  for  differential  prediction  of  per¬ 
formance  in  combat,  technical,  and  administrative  duties  and 
to  determine  equivalence  of  the  criteria. 

46.  Hodge,  D.  C.  (Ed.)  Military  requirements  for  researcii  on  contin¬ 
uous  operations.  U.  S.  Army  Human  Engineering  Laboratories 
Technical  Memorandum,  April  1972,  Ho.  12-72. 

Presents  papers  delivered  at  a  conference  on  ta-k,  environ¬ 
mental,  and  nutritional  variables  affecting  man's  ability  to 
perform  for  long  periods  of  time,  as  well  as  factors  influencing 
recovery  from  the  effects  of  long-term  performance.  Representatives 
of  the  Defense  Department  community  3nd  contractors  presently 
performing  research  related  to  continuous  operations  discuss 
the  concept  and  attempt  to  formulate  goals  and  identify  gaps  in 
the  knowledge  of  long-term  performance  and  recovery. 

47.  Lidberg,  L. ,  &  Seeman,  K.  Psychomotor  performance  before  and  after 
confinement  in  a  shelter.  Reports  from  the  Laboratory  for  Clinical 
Stress  Research,  Karolinska  Sjukhuset,  November  1969,  Ho.  9. 
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Twenty-seven  healthy  military  recruits  underwent  shooting 
exercises  before  and  after  a  52-hour  confinement  in  an  experi¬ 
mental  shelter.  Ss  were  exposed  to  various  c.ondi"ions  of 
physical  discomfort  during  confinement,  including  (c)  relatively 
high  temperature,  relative  humidity,  and  CO^  concentration; 

(b)  minimal  space/j erson;  and  (c)  the  necessity  of  eating  cold 
food,  llachine  pistol  shooting  performance  was  measured  several 
days  before  and  immediately  after  confinement,  at  the  same  time  of 
day  on  both  occasions.  While  no  significant  differences  were  found 
in  group  mean  scores  on  either  task  before  and  after  confinement, 
there  were  considerable  differences  in  performance  among  the  indi¬ 
viduals. 

48.  Luc'nsinger,  V.  r  ■  An  annotated  bibliography  of  selected  works 
in  ambiguity  an<  its  effect  on  decision  making.  Lubbock,  Texas: 
Texas  Technical  University,  December  1971. 

Provides  a  comprehensive  review  of  the  decision  making  area 
with  good  annotation. 

49.  Smith,  S.,  &  Haythorn,  W.  W.  Effects  of  compatibility,  crowding, 
group  size,  and  leadership  seniority  on  stress,  anxiety,  hostility, 
and  annoyance  in  isolated  groups.  Journal  of  Personality  & 

Social  Psychology.  April  1972,  22(1),  67-79. 

Results  showed  the  highly  interactive  nature  of  the 
relationships  between  the  subjective  reactions  of  individuals 
in  groups  and  both  social  and  physical  aspects  of  the  group 
setting.  In  the  experiment,  56  naval  enii"ted  r.;en  were 
exposed  to  laboratory  conditions  of  isolation  and  confinement 
for  21  days. 

50.  Streufert,  S.,  &  Streufert,  S.  Perceptions  of  information  rele¬ 
vance  and  importance  under  treui  stress.  Purdue  University 
Technical  Report,  ilo.  46,  June  1972.  (a) 

Treui  stress  refers  to  conflict  among  three  parties  where 
no  coalitions  are  formed.  Participants  were  found  to  have  an 
increased  perception  of  information  relevance  under  treui  stress. 

51.  Streufert,  S.,  &  Streufert,  S.  Psychological  and  psycho-political 
variables  in  social  perception,  decision  making,  and  social  inter¬ 
action  in  complex  environments.  Purdue  University  Technical 
Report  llo.  47  (Final  Report),  August  1972.  (b) 

Provides  a  recapitulation  of  research  done  on  perception  and 
decision  making  in  complex  environment  which  was  reported  in  46 
reports  over  a  period  of  four  years. 
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Streufert,  S.,  &  Strauf  ;,rt,  S.  Effects  of  increasing  failure 
and  success  on  military  and  economic  risk  taking.  Journal  of 
Applied  Psychology.  October  1970,  54(3) ,  393-400. 

Risk  taking  increases  with  the  length  of  time  that  decision¬ 
making  groups  spend  working  on  a  task.  After  some  time,  risky 
decision  making  may  become  concentrated  in  one  decision  area  at 
a  time.  Study  was  based  on  a  Tactical  Negotiations  Game. 

Streufert,  S.,  &  Streufert,  S.  The  effect  of  information, 
quantity  and  time  spent  in  military  decision  making  on  the  degree 
of  risk  taking:  An  analysis  via  an  experimental  simulation  tech¬ 
nique.  Purdue  University  Technical  Report,  No.  15,  September  1908.  (a) 

The  report  found  that  risk  taking  readies  its  highest 
level  under  optimal  information  conditions. 

Streufert,  S.,  &  Streufert,  S.  Risk  taking  in  military  and  economic 
decision  making:  An  analysis  via  an  experimental  simulation. 

Purdue  University  Technical  Report,  No.  16,  November  1968.  (b) 

Results  indicate  that  risk  taking  t^ds  to  increase  as  a  function 
of  the  time  spent  ip  the  decision-making  situation. 

Strub,  ii.  H.  Perception  of  military  event  patterns  in  a  two- 
alternative  prediction  task.  U,  S.  Army  BESRL  Technical  Research 
Note,  February  1970,  No.  221. 

In  a  study  of  perception  of  military  event  patterns,  research 
effort  wfs  focused  on  the  recognition  of  couple::  cues  to  enemy 
action.  An  attempt  was  made  to  determine  the  role  of  (a)  dif¬ 
ferent  forms  of  second-order  patterns,  (b)  second-order  strength, 

(c)  continuity,  and  (d)  experience  as  factors  in  the  recognition 
of  second-order  patterns. 


Organizational  Factors 

Boldt,  U.  F.  ‘"enerating  random  information  for  experimental 
decision  problems.  U.  S.  Army  PRO  Technical  Research  Note, 

1966,  No.  171. 

Reports  on  various  methods  used  to  generate  information 
through  random  processes  whi^h  to  some  degree  simulate  the  random¬ 
ness  and  inconsistency  of  actual  combat  information.  Deals 
with  probable  structure  of  enemy  forces  and  location  of  prob¬ 
able  attack.  Results  suggest  the  feasibility  and  utility  of 
model  development  for  simulation  research  in  man-machine 
nodels. 
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Bons,  P.  M. ,  Bass,  A.  R.,  &  Konorita,  A.  S.  Changes  in  leadership 
style  as  a  function  of  military  experience  and  type  of  command. 
Personnel  Psychology,  1970(Win),  23(4) ,  551-568. 

Seven  dimensions  of  leadership  were  measured  for  graduates 
of  West  Point  in  1965.  Results  indicate  that  leadership  style 
changes  over  command  experience  and  that  different  levels  of 
command  experience  produce  different  types  of  changes. 

Castellan,  II.  J.,  Jr.  A  model  for  the  analysis  of  multiple 
strategies.  Psychometrika,  1966,  31(4) ,  475-490. 

Study  describes  manner  in  which  tiie  strategy  of  decision 
makers  can  be  analyzed.  From  this  noael  can  be  derived  the 
range  of  utility  corresponding  to  the  use  of  a  particular  strategy 
and  the  effective  or  observed  use  of  the  strategy  by  the 
decision-maker. 

Cockrell,  J.  T.  Maintaining  target  detection  proficiency  through 
team  consensus  feedback.  U.  S.  Army  BESRL  Technical  Research 
Rote,  December  1969,  No.  219. 

The  research  found  that  team  consensus  feedback  was 
effective  in  maintaining  and  enhancing  target  detection 
performance  by  interpreter  field  units. 

Davis,  J.  H.  Group  performance.  Reading,  Mass.:  Audison- 
Wesley  Publishing  Company,  1969. 

Provides  a  discussion  of  the  effects  of  group  structure 
on  performance.  Small  group  performance  is  divided  into  three 
segments  for  analysis:  group  product,  the  output  following  work 
on  some  task;  group  structure,  the  pattern  of  interpersonal 
relations  within  the  group;  group  process,  the  activities  that 
take  place  along  the  structural  paths. 

Durkin,  J.  E.,  Jr.  Groups  and  loops:  A  study  of  social  behavior 
process  in  team  performance  tasks.  Dissertation  Abstracts, 

1967 ,  27(11A),  3930-3931. 

Callahan,  J.  E.  Initial  efforts  in  validating  a  computer  model 
of  social  behavior.  Psychological  Reports,  1966.  19f3-Pt.l). 

786.  - 


Describes  the  efforts  to  validate  HOMUNCULUS — a  computer  model 
of  social  behavior,  involving  simulation  decision-making  in  three 
role-conflict  situations. 

Kuhn,  D.  C,  The  effect  of  stressful  work  environments  on  task 
related  anxiety  and  group  cohesion.  Dissertation  Abstracts 
International ,  May  1972,  2 3 (11-12) . 


64.  Lange,.  C.  J.  Leadership  in  small  military  units:  Some  research 
findings.  HumRRO  Professional  Paper,  1967,  No.  24-67 

Describes  several  research  studies  of  the  leadership 
process  ir.  small  military  units.  Includes  a  conceptual  framework 
which  had  been  formulated  in  the  course  of  the  work,  and  a  general 
description  of  the  approach  taken  in  developing  an  experi¬ 
mental  leadership  training  program.  The  findings  emphasize 
the  active  role  of  the  leader  in  facilitating  performance, 
motivating  performance,  and  reducing  disrtptive  influences. 

65.  Lundberg,  C.  C.  Patterns  of  organizational  decision  making:  A 
conceptual  scheme  and  its  application  in  a  study  of  comparative 
cases  in  industry.  Dissertation  Abstracts,  1967,  27(3-A) , 

2628. 

66.  Nelson,  M.  B. ,  Jr.  An  analysis  of  administrative  decision  making 
through  the  empirical  testing  of  a  model.  Dissertation  Abstracts, 
1966,  27(4-A),  911. 

67.  Nelson,  P.  D. ,  &  Berry,  N.  H.  Cohesion  in  Marine  recruit  platoons. 
Journal  of  Psychology,  1968,  68(1) ,  63-71. 

In  this  study,  cohesiveness  of  Marine  basic  training  platoons 
was  observed  to  be  relatively  stable  over  a  two-iionth  period  and 
was  related  to  platoon  personnel  composition.  Cohesiveness  was 
not  found  to  be  correlated  with  performance  measures. 

68.  O'Brien,  G.  E.  Group  structure  and  productivity.  Australian 
Military  Forces  Research  Report,  August  1970,  Ho.  7-70. 

Pvesearch  accomplished  for  the  Australian  Array  found 
that  group  interaction,  productivity,  performance,  and  leader 
effectiveness  are  related  to  task,  status,  productivity,  and 
quality  of  leader-member  interpersonal  relations. 

69.  Rapoport,  A.  Dynamic  programming  models  for  multistage  decision 
making  tasks.  Journal  of  Mathematical  Psychology,  1967,  4(1) , 
48-71. 

Presents  a  dynamic  programming  approach  for  solving 
multistage  decision-making  problems.  Group  and  individual 
decisions  are  analyzed  in  terms  of  an  adaptive  and  nonadaptive 
model. 

70.  Roeckelein,  J.  E.  Simulation  of  Organization:  An  Annotated 
Bibliography.  HumRRO  Technical  Report,  1967,  No.  67-14,  vii. 

Provides  a  bibliography  containing  141  annotated  references 
in  the  simulation  of  complex  social  cganizations.  It  is  part 
of  a  study  to  determine  the  feasibility  of  using  simulation 
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methods  to  conduct  research  on  human  factors  that  influence 
organizational  effectiveness.  It  is  divided  into  three 
principal  areas:  man-centered,  man-machine,  and  machine- 
centered  simulation. 

71,  Sidorsky,  R.  C.,  &  Houseman,  J.  F.  Research  on  generalized  skills 
related  to  tactical  decision  making.  NAVTRADEVCEN  Technical 
Report,  1966,  No.  1329-2,  vi,  104. 

Part  I  was  concerned  with  the  effects  on  decision  making 
behavior  of  the  time  period  over  which  the  critical  phase  of  a 
tactical  situation  develops.  Part  II  deals  with  anticipation  of 
opponents*  action  in  attacking.  Some  implications  for  decision¬ 
making  training  devices  and  procedures  are  discussed. 

72,  Springer,  R.  Ii.  An  analysis  of  attitudes  toward  the  legitimacy  of 
supervisor  influence  in  a  mil"  .arv  environment.  Dissertation 
Abstracts  International,  February  1971,  31 (o-A) ,  3721-3722. 

Attitudes  toward  legitimacy  of  supervisory  influence, 
g^oup  attitude  agreement,  and  incidence  of  dysfunctionalism 
ot  military  basic  trainees  and  platoon  drill  sergeants  are 
reported.  The  study  shows  that  there  is  a  difference  between 
attitudes  of  superiors  and  subordinates  toward  the  legitimacy 
of  supervisory  influence  under  certain  conditions,  and  that 
these  differences  seen  to  be  related  to  the  work  environment. 

73 ,  Stager,  P.  Conceptual  level  as  a  composition  variable  in  small 
group  decision-making,  Princeton  University:  ONR  Report,  February 
1966. 

Results  indicated  in  part,  that  with  an  increase  in  percentage 
of  members  of  a  high  conceptual  level  in  a  group,  there  is  a  de¬ 
crease  in  structuring  and  more  functional  role  uncertainty. 

Stager,  P.,  &  Kennedy,  J.  L.  Decision  making  and  performance  in 
heterogeneous  groups.  Princeton  University,  Department  of  Psycho¬ 
logy,  February  1965. 

Tne  study  found  that  the  cognitive  complexity  of  groups 
determined  their  mode  of  operating.  Economic  games  v/ere  used 
as  a  basis  for  the  study. 


Biographical  Factors 

75#  Arthur,  k.  J.  Success  is  predictable.  San  Diego:  USA  iiedical 
Neuropsychiatric  Research  Unit,  Report,  1971,  No.  71-18. 

,.n  actuarial  approach  to  predicting  illness  or  Lne  recovery 
from  illness  is  presented.  It  discusses  the  use  of  biochemical 
and  environmental  indices  of  one's  state  of  hen  1th  and  the 
application  of  these  indice.-,  to  performance  levels. 


Berry,  II.  H.,  &  Nelson,  P.  !).  The  Cate  of  school  dropouts  in 
the  Karine  Corps.  Personnel  &  Guidance  Journal,  1966,  4b  (1) , 
20-23. 


A  study  of  3,731  Marines  showed  that  those  completing  high 
school  before  enlistment  have  higher  success  rates  than  do  those 
who  drop  out  of  high  school,  and  that  of  the  dropouts,  those  com¬ 
pleting  their  education  after  enlistment  have  a  higher  success 
rate  than  those  not  completing  their  education. 

Bialek,  H. ,  &  McNeil ,  M.  Preliminary  study  of  motivation  and 
incentives  in  basic  comoat  training.  HumRRO  Technical  Report, 

1968,  ilo.  68-6,  vii. 

Nineteen  incentives  were  identified  by  two  groups  of 
trainees  as  being  reliable  and  of  low  variability  as  measures 
of  subjective  reward  values  of  basic  combat  t raining (BCT) .  Of 
these,  the  ten  most  attractive  were  categorized  into  one  oi  three 
classes:  recognition  (peer  and/or  social),  material  reward, 
or  autonomy  (freedom).  It  was  concluded  ihat  the  ten  specific- 
incentives  identified  and  the  categories  ot  recognition  and 
autonomy  migl  v.  be  controlled  and  varied  to  measure  the  effec¬ 
tiveness  of  variations  in  BCT. 

Bourne,  P.  G.,  Coli,  W.  M. ,  &  Datel,  W,  li.  Affect  levels  of  ten 
Special  Forces  soldiers  under  threat  of  attack.  Psychological 
Reports,  1968,  22(2),  363-366. 

Four  administrations  of  the  Weekly  Multiple  Affect  Adjective 
Check  List  (W-MAACL)  were  obtained  on  ten  Special  Forces  "A"  Ten.:, 
soldiers  in  South  Viet  Ham  during  a  period  of  an  anticipated 
enemy  attack.  Results  compared  Anxiety,  Depression,  and  Hos¬ 
tility  levels.  Both  in  terms  of  W-MAACL  scores  and  participant 
observations,  hostility  was  the  dominant  affecc  expressed. 

Carver,  R.  P.,  &  Winsmann,  F.  R.  Relationship  between  physical 
work  performance  and  age.  Ergonomics,  1970,  13(2) ,  247-233. 

Results  from  the  ter.  basic  titness  tests  of  L.  A.  Fleishman 
and  five  tests  of  the  Army  Physical  Combat  Proficiency  Test 
are  given.  Mine  of  the  tests  showed  a  consist ant  downward  trend 
from  ages  19-30. 

Clum,  G.  A.,  &  Mahan,  J.  L.  Attitudes  predictive  of  Marine  combat 
effectiveness.  Journal  of  Social  Psychology,  February  1971, 

83(1),  55-62. 

Attitudes  of  224  Marines  were  measured  at  the  end  of  recruit 
training,  and  of  137  Marines  after  two  years  of  active  duty,  using 
the  Marine  Corps  Opinion  Survey.  Subjects  attitudes  were  found  to  be 
related  to  a  criterion  of  rated  combat  effectiveness  obtained 
approximately  45  mon.chs  after  entrance  into  service. 
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81.  Csoka,  S.,  &  Fiedler,  F.  E.  Leadership  and  intelligence:  A 
contingency  model  analysis.  Proceedings  of  the  Annuel  Convention 
of  the  American  Psychological  Association,  1972,  7(Pt.  1) , 

439-4^0. 

The  contingency  model  postulates  that  group  performance 
depends  upon  the  leader's  motivational  style  and  situational 
favorableness  or  the  degree  of  power  and  influence  provided 
by  the  situation.  Three,  studies  show  that  leader  intelligence 
and  experience  interact  in  determining  the  leader's  "expert" 
power  and  thus  there  exists  the  relationship  between  leader  moti¬ 
vational  style  and  performance  (i.e.,  less  intelligent  leaders 
do  not  learn  from  experience). 

82.  Datel,  W.  E.,  &  Lifrak,  S.  T.  Expectations,  affect  change,  and 
mili cary  performance  in  the  Army  recruit.  Psychological  Reports, 
1969,  24(3),  855-879. 

The  distressful  affective  response  of  Army  recruits  to  basic 
combat  training  (BCT) .  Several  features  of  the  inverted  U  BCT 
distress  curve  were  replicated  on  Subjects  measured  repeatedly 
with  the  Multiple  Affect  Adjective  Check  List  (MAACL) .  Subjects 
expectations  of  BCT  distress  were  much  lower  than  the  actual 
distress  levels  later  reported. 

83.  Egbert,  R.,  et  al.  Fighter  I:  A  study  of  effective  and  ineffective 
combat  performers.  HumRRO  Special  Report,  1958,  No.  13. 

Study  was  designed  to  obtain  as  complete  a  description  as 
possible  of  the  differences  between  soldiers  who  were  judged  to 
be  effective  and  ineffective  combat  performers  in  the  Korean 
conflict.  A  40-hour  battery  of  psychological  tests  i  ;re  used  as 
the  basic  test  instrument. 

84.  Herman,  M.  G.,  &  Kogan,  N.  Effects  of  representative  status  and 
decision  style  on  cooperation  in  the  prisoner's  dilemma.  Prfcnce- 
ton,  N.  J.:  Educational  Testing  Service  RB-72-45,  October  1972. 

An  investigation  of  the  effects  of  personality,  reference 
group,  and  feedback  on  prisoners'  dilemma  outcomes. 

85.  Jacobs,  T.  0.  Leadership  in  small  military  units.  HumRRO  Profes¬ 
sional  Paper,  1968,  No.  42-68. 

Describes  a  16-hour  military  leadership  training  program 
for  junior  officers  based  in  part  on  data  from  questionnaires 
used  to  measure  leader  behavior  variables.  Leader-follower 
relationships,  differences  between  emergent  and  appointive 
leaders,  the  training  value  of  the  situational  approach  and 
small  group  discussions,  are  presented. 
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:-  I  86.  Johnson,  C.  D.,  Waters,  L.  u. ,  and  Heine,  W.  H.  Factor  analysis 

i  1  of  experimental,  non-cognitive  measures  of  combat  potential.  US  AFRO 

I  Technical  Research  Note,  196A,  No.  14  7 . 

¥  I 

l  \  As  a  means  of  identifying  personality  factors  important  in 

|  f  combat  potential,  scores  on  19  noncognitive  aptitude  tests,  5 

measures  of  avocational  information,  7  cognitive  tests  of  the 
ACB,  and  1  experimental  perceptual  speed  measure  were  factor- 
analyzed.  Two  factors,  general  cognitive  ability  and  a  mechanical- 
social  factor,  were  valid  for  the  criterion  of  combat  potential. 


t 


87. 


Mahan,  J.  L.  &  Clum,  G.  A.  Longitudinal  prediction  of  Marine  corabat 


effectiveness.  Journal  of  Social  Psychology,  February  1971,  83(1), 
45-54. 


A  sample  of  331  Marines  was  studied  to  define  factors  related 
to  a  battlefield  superior  officer  rating  of  effectiveness  in 
combat.  Factors  predictive  of  combat  effectiveness  were  found 
for  (a'  preservice  peisonal  background;  (b)  educational  experi¬ 
ence;  and  (c)  Marine  Corps  adjustment  and  proficiency  at  recruit 
training,  and  two  years  of  service.  Results  show  that  the  mature, 
better  educated,  more  intelligent  Marine,  who  has  made  a  good 
military  adjustment  (as  indicated  by  his  proficiency,  obedience, 
and  physical  and  emotional  health),  is  most  effective  during 
corabat. 

88.  Schwartz,  S.  Tank  crew  effectiveness  in  relation  to  the  supervisory 
behavior  of  the  tank  commander.  HumRRO  Technical  Report,  1968, 

No.  68-12. 


Exau tnes  the  relationships  between  supervisory  behavior 
of  the  tank  commander  (TC '  md  the  performance  of  the  tank  crew. 
Tests  of  effectiveness  in  performing  maintenance  and  effec¬ 
tiveness  of  performance  in  a  tactical  exercise  were  administered 
to  two  groups  of  tank  crews.  It  was  fuund  th3t  supervisory 
activities  by  the  TC  may  either  facilitate  or  hinder  a  crew's 
performance.  There  appeared  to  be  some  role  confusion  and 
ineffective  communication  between  crewmen  and  TC;  and  TCs  often 
performed  duties  within  the  capabilities  of  their  crewmen. 

89.  Jrivastava,  S.  S.  Load  carriage  by  infantry  soldiers 

Criteria  for  assessment  of  physiological  end  psychological  fatigue. 
Defense  Science  Journal,  1968,  18(2),  53-60. 

This  study  incorporated  physiological  and  psychological  tests 
in  an  attempt  to  develop  suitable  criteria  for  assessing  fatigue 
at  the  end  of  a  given  task  in  field  studies  pertaining  to  load 
carriage.  Only  two  tests  were  found  suitable  for  fatigue  tests. 
Results  revealed  a  consistently  progressive  fall  in  eosinophil 
count  with  increasing  levels  of  fatigu'  The  pulse  recov.ty  index 
which  was  a  measure  of  the  rate  of  pulse  recovery  after  exercise, 
was  lower  with  higher  levels  of  fatigue. 
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90.  Strange,  R.  E.  Combat  fatigue  versus  pseudo-combat  fatigue  in 
Vietnam.  Military  Medicine,  1968,  133(10) ,  823-826. 

Individuals  who  were  hospitalized  after  developing  psychi¬ 
atric  symptoms  in  an  acute  stress  situation,  but  who  manifested 
feelings  of  guilt  and  who  had  a  good  prestress  history,  were 
considered  true  combat  fatigue  cases  and  frequently  were  returned 
to  duty.  Soldiers  who  presented  symptoms  similar  to  those  of 
true  combat  fatigue,  but  who  had  no  guilt  or  desire  to  return 
to  duty  and  who  had  a  history  of  poor  adaptive  capacity,  were 
generally  diagnosed  as  neurotic  or  personality  disorder  and  re¬ 
moved  from  the  combat  zone. 


Miscellaneous 


91.  Barlow,  E.  Abstracts  of  personnel  research  reports:  VIII. 
1954-1968.  USAF  AFHRL  Technical  Report,  1968,  No.  68-124. 

Includes  abstracts  of  the  444  technical  reports  issued 
over  a  5-year  period  by  the  Air  Force  Personnel  Research 
Division.  They  cover  studies  in  selection,  classification, 
and  utilization  of  personnel;  systematizing  information  flow 
in  support  of  personnel  planning;  methods  of  describing, 
evaluating,  and  structuring  jobs;  and  development  of  pro¬ 
cedures  for  improving  the  quality  of  personnel. 

92.  Datel,  W.  E.,  &  Legters,  Llewellyn  J.  Reinforcement  measurement 
in  a  social  system.  Journal  of  Biological  Psychology,  July 
1967,  13(1),  33-38. 

Describes  a  method  for  assessing  the  indigenous  motivational 
forces  in  a  social  environment.  Preparatory  to  engineering  a 
program  of  contingency  management  in  Army  basic  combat  training, 
the  nature  and  extent  of  the  reinforcement  already  present  in 
the  training  system  were  measured. 

93.  Markowitz,  I.  The  military  mind.  Psychiatric  Quarterly,  1971, 

45(3).  440-448.  '  "  “  "  “  “ 

Hypothesizes  similarities  between  the  military  and  the  neurotic 
mind.  An  analysis  is  presented  of  military  training  and  the  quali¬ 
ties  which  are  fostered  and  frustrated  xn  that  process. 

94.  Martin,  T.,  Helm,  C.  E.,  Green,  B.,  &  Martin,  M,  The  assessment 
of  human  performance  for  the  analysis  of  space  missions.  Behav- 
ioral  Science.  1967,  12(6).  490-497. 

Considers  the  problem  of  developing  a  computer  program 
to  assist  the  aerospace  pyschologist  in  the  task  of  assessing 
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human  perfomance  reliability.  Procedures  were  developed  to 
permit  analyses  of  physiological  and  psychological  variables 
relevant  to  human  performance  in  space.  A  resultant  reliability 
for  each  task  was  calculated.  The  minimum  reliability  v/ithin  a 
given  time  period  is  used  to  produce  a  reliability  profile. 

95,  Uunnelly,  C.  L.,  Klemmer,  A.  G.,  Curigan,  R.  ii.,  &  Kaufman,  R.  S. 

The  instructional  system  approach  to  maintenance  technical  training: 
Development  and  imolementation  model.  Human  Factors,  1966,  8(2), 
163-172. 

An  instructional  system  model  is  presented  for  meeting 
maintenance  technical  training  requirements  fo»*  USAF  weapon 
systems.  Methodology  is  presented  for  determining  training 
requirements  and  satisfying  appropriate  methods/media  combi¬ 
nations  for  meeting  student  terminal  performance. 

96,  Potter,  K.  W. ,  Tulley,  A.  T. ,  &  Reed,  L.  il.  Development  and  appli¬ 
cation  of  computer  software  techniques  to  human  factors  task  data 
handling  problems.  USAF  AMRL  Technical  Report,  1966,  ilo.  o6-200, 
viii. 

Discusses  research  leading  to  application  of  computer  soft¬ 
ware  techniques  for  handling  human  factors  task  data  generated 
in  support  of  aerospace  system  development  programs.  Concept 
of  an  operational  system  for  storing,  processing  and  reviewing 
human  factor  task  data  is  discussed. 

97,  Powers,  T.  R, ,  &  DeLuca,  A.  J.  Knowledge,  skills,  and  thought 
processing  of  the  battalion  commander  and  principal  staff  officers. 
HumRKO  Technical  Report,  July  1972,  No.  /2-20. 

Describes  research  approach  for  development  of  commander  and 
staff  officer  knowledge  and  skill  inventory  using  the  Air  Force 
Job  Analysis  method. 

98,  Reed,  L.  li.  Advances  in  the  use  of  computers  for  handling  human 
factors  task  data.  USAF  AMRL  Technical  Report,  1967,  No.  67-16. 

Decribes  techniques  to  assist  the  human  factors  specialist  in 
industry  and  the  government  to  make  better  use  of  available  data 
for  making  decisions  about  the  training  of  systems  maintenance  and 
operator  personnel.  Discussed  development  of  techniques  to  handle 
and  process  human  factors  task  data  (task/maintenance  analysis). 

99,  Siegel,  A.  I.,  &  Wolf,  J.  J.  Digital  simulation  of  submarine  crew 
performance:  II  Computer  implementation  and  initial  results  of 
the  application  of  a  psychosocial  "model"  for  digitally  simulating 
crew  performance.  Wayne,  Pa.:  Applied  Psychological  Services, 

1965,  vi. 
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Model  described  is  one  of  a  series  of  reports  in  a  technique 
for  simulating  the  performance  of  submarine  crews  operating  in 
confined  quarters  for  extended  periods  of  time. 

100.  Siegel,  A.  I.,  Wolf,  J.  J.,  &  Lanterman,  U.  S.  Digital  simulation 
of  crew  performance:  Validation  of  a  digital  simulation  model  for 
crew  performance  simulation.  Wayne,  Pa.:  Applied  Psychological 
Services,  1967,  vii. 

The  validity  of  a  digital  simulation  model  designed  to 
predict  an  actual  operational  naval  situation  was  tested. 

The  technique  for  the  total  manning  complement  and  the  manning 
of  individual  specialties  was  deemed  acceptable.  Predictions 
such  as  the  number  of  hours  worked  by  the  crew  members,  the 
overtime,  and  the  non-essential  subtasks  which  would  be  post¬ 
poned,  were  in  accord  with  the  criterion  data.  When  computer 
data  were  evaluated,  the  value  of  the  simulation  technique  was 
similarly  supported.  The  model  can  be  used  in  developing  man¬ 
ning  recommendations  and  for  predicting  man-machine  performance 
while  a  system  is  in  the  design  state. 

101.  Tulley,  A.  T.,  &  Meyer,  G.  R.  Implementation  of  computer  software 
techniques  to  human  factors  task  data  handling  problems.  USAF  AKRL 
Technical  Report,  1967,  Wo.  67-127,  vii. 

Techniques  explored  in  this  research  program  are  based  on  the 
assumption  that  a  user-oriented  computerized  data  system  will 
help  draw  human  factors  specialists  closer  to  needed  data.  Com¬ 
puter  software  descriptions  are  presented  for  implementing  the 
experimental  system  as  a  user-oriented  environment  in  terms  of 
information  needs  of  human  factors  specialists. 


30 


